THE PROPAGATION OF MOLECULAR CHAOS 
BY MARKOV TRANSITIONS 

By Alexander Gottlieb 
Abstract 

We establish a necessary and sufScient condition for the propaga- 
tion of chaos by a family of many-particle Markov processes, if the 
particles live in a Polish space S: A sequence of n-particle Markov 
transition functions {Kn} propagates molecular chaos if and only if the 
sequence {Kn{sn, ■)} is chaotic whenever s" = (s", S2, ■ ■ ■ , s") € 5" is 
such that ^ J2i H^?) converges to a law on S a,s n — > 00. |^ Q 

1 Introduction 

The "propagation of chaos" means the persistence in time of molecular chaos 
(i.e., the stochastic independence of two random particles in a many-particle 
system) in the limit of infinite particle number. Propogation of chaos is an 
important concept of kinetic theory that relates the equations of Boltzmann 
and Vlasov to the dynamics of many-particle systems. 

The concept of propagation of chaos originated with Kac's Markovian 
models of gas dynamics ||9|, Kac invented a class of interacting parti- 
cle systems wherein particles collide at random with each other while the 
density of particles evolves deterministically in the limit of infinite particle 
number. A nonlinear evolution equation analogous to Boltzmann's equation 
governs the particle density. The processes of Kac were further investigated 
with regard to their fluctuations about the deterministic infinite particle 



limit in |13, 22, McKean introduced propagation of chaos for interact- 



ing diffusions and analyzed what are now called McKean- Vlasov equations 
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11, 12]. Independently, Braun and Hepp 0] analyzed the propagation of 



chaos for Vlasov equations and proved a central limit theorem for the fluctu- 
ations. Analysis of the fluctuations and large deviations for McKean- Vlasov 
processes was carried out in |21, 19, ^. Other instances of the propaga- 

17, §]. Finally, we refer the reader 



tion of chaos have been studied in |]I5|, ^ ^ 

to the long, informative articles by Sznitman [^0| and by Meleard [14| in 
Springer- Verlag's Lecture Notes in Mathematics. 
This article is organized as follows: 

In Section |2|, molecular chaos is defined and a class of examples is pro- 
vided. The weak convergence approach to the study of molecular chaos due 
to Sznitman and Tanaka is introduced in Theorem 2A. In Section ^, prop- 
agation of chaos is defined, and the main results of this article are stated 
in Theorem 3T and its corollary. Theorem 3^ is proved in Section |^ using 
Prohorov's theorem and Theorem 2.1 of Section ||. 



2 Molecular Chaos 

In what follows, if {S,ds) is a separable metric space, its Borel algebra will 
be denoted B{S), the space of bounded and continuous functions on S will 
be denoted C(5), and the space of probability laws on S with the weak 
topology will be denoted 'P{S). 

Let S'"' denote the n-fold product of S with itself; 

S*" := {(si,S2, . . . ,s„) : Sj e 5 for i = 1, 2, . . . , n} . 

5" is itself metrizable in a variety of equivalent ways that all generate 
the same topology and the same Borel algebra B{S^). If />„ is a law 

(k) 

on 5" and k < n, let pn denote the marginal law on the first k co- 
ordinates, that is, the law on induced by the map {si,S2,--- i-^ 
(si, . . . , Sfc). If /9 G ^{8), let /9®" denote the product law on defined by 

Isr. flisi) ■ ■ ■ fn{Sn)p^''{dsi ■ ■ ■ dsn) = W=l Is h{^)p{dx). 

Let Yin denote the set of permutations of {1, 2, . . . , n}. The permutations 
n„ act on by permuting coordinates: the map tt- : 5"" — > 5" is 

Vr • (Sl, S2, •••,««):= (•S7r(l) > ■57r(2) > • • • ) STrM)- 

If E is any subset of S", define 

TT • E' = {vr • s : s G E}. 
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A law p on is symmetric if p{'K ■ B) = p{B) for all vr € n„ and all 
B € B{S'^). Products p®" are symmetric, for example. The symmetrization 
yO of a law p G V{S^) is the symmetric law such that 

7ren„ 

for ah B e 

For each n, define the map £n ■ — > T^iS) by 

1 " 

£n{{si,S2,... ,Sn)) ■■= -y^J{Si), (1) 

1=1 

where 5{x) denotes a point-mass at x. These maps are measurable for each 
n, and en(^ • s) = en(s) for all s G 5", tt G II^. 

To derive the Boltzmann equation for a dilute gas, Boltzmann assumed 
that a condition of "molecular disorder" obtains, i.e., the velocities of two 
random molecules in a gas are stochastically independent [||. This is not 
an entirely realistic assumption: surely the collisions between the molecules 
of an n-particle gas must introduce some stochastic dependence, even if the 
molecules were independent to begin with. Nonetheless, if the number n of 
molecules is very large, one might well expect that the velocities of two ran- 
dom molecules would be nearly independent; the presence of so many other 
molecules should wash out most of the dependence between two randomly 
selected molecules. These considerations motivated Kac to define molecular 
disorder as a kind of asymptotic independence of pairs of particles in the 
infinite-particle limit. He called the definiendum the "Boltzmann property" 
instead of "molecular chaos" or simply "chaos," as it is now termed. Kac's 
definition is 



Definition 2.1 (Kac, 1954) Let {S,ds) be a separable metric space. Let 
p be a law on S, and for n = 1, 2, . . . , let pn be a symmetric law on S*". 

The sequence {pn} is /O-chaotic if, for each natural number k and each 
choice (j)i{s), (p2is), ■ ■ ■ , (pkis) of k bounded and continuous functions on S, 

k 

lim / (t)i{si)(t)2{s2)---<i)k{sk)Pn{dsids2...dsn) =\\ 1 4>i{s)p{ds). 



It is now known 21, 0] that a sequence of symmetric laws {pn} (with 
Pn € V{S"')) is jO-chaotic if and only if the marginals pn^ converge weakly 
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to p® as n — > oo for each fixed k. (We suggest that this last condition 
be taken for the definition of chaos in the future, in view of its simpHcity 
and equivalence to Kac's definition.) The following theorem gives conditions 
that are equivalent to molecular chaos. 

Theorem 2.1 (Sznitman, Tanaka) Let S he a separable metric space, 
and for each n let pn he a symmetric law on 5". 
The following are equivalent: 

(i) {pn] is p-chaotic; 

(a) For all 01,02 G Cb{S), 

lim / 4>iisi)<p2{s2)Pn{ds) = / (t)i{s)p{ds) / 4>2{s)p{ds); 

(2) 

( Hi ) The marginals ph converge weakly to p® p as n tends to infinity. 

(iv) For all k, the marginals pn^ converge weakly to p®^ as n tends to in- 
finity. 

(v) The laws pn o e~"^ converge to S{p) in V{V{S)) as n tends to infinity; 

An important class of chaotic sequences arises in connection with the 
principle of equivalence of microcanonical and canonical averaging of statis- 
tical mechanics. The principle follows from the molecular chaos of sequences 
of microcanonical distributions. For example, let 5 be a finite set and let 
H : S — > R be any function that we call energy: H{s) is the energy of a 
particle if it is the state s (z S. Fix G M, to be interpreted as average 
energy per particle, and 5 > 0, and define Pn,E,5 £ V{S'^) to be the law 
that gives equal probability to each n-particle state (si, S2, . . . , Sn) that sat- 
isfies ^ X^iLi H{si) € {E — ^^^^ E + ij) and probability to all other points 
of 5". Thus, the "microcanonical distributions" Pn,E,5 render equiproba- 
ble all n-particle states for which the energy-per-particle is approximately 
E. The sequence of microcanonical distributions {pn,E,5}n<=N is 7-chaotic, 
where 7 € V{S) is the Gibbsian distribution defined by 

for all t £ S, where the parameter /3 depends on E and d. This follows from 
Sanov's large deviations theorem. 

In closing, we note the following pleasant corollary of Theorem |2.1| (see 
[0] for a proof): 
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Corollary 2.1 Let S = {si,S2,--- ,Sk} be a finite set, and for each n let 
Pn G 'P{S^) he a symmetric law. 

If the sequence {pn} is p-chaotic, then 

lim i - Y] pn(x)log/9„(x) I = y^pilogpi. 
\ xe5" / i=l 



3 The Propagation of Chaos 

Let (5, ds) and (T, dx) be two separable metric spaces. A Markov transi- 
tion function ii' is a function on S" x ;B(T) that satisfies the following two 
conditions: 

(1) •) is a probability measure on (T, i3(T)) for each s € S", and 

(2) K{-,E) is a measurable function on (S,B{S)) for each E € B{T). 
A Markov transition function on x B(T) is also called a Markov tran- 
sition from S to T. 

A Markov process on a state space {S,ds) determines a family, indexed by 
time, of Markov transitions from S to itself: {K{s, E, t)}t>o- The transitions 
satisfy the Chapman-Kolmogorov equations 

K{s, E,t + t')= [ K{s, dx, t)K{x, E, t'); t,t' > 0, s e S, E e B{S) 
Js 

in addition to (1) and (2) above. 

For each n, let Kn be a Markov transition from 5" to We assume 
that the Markov transition function Kn is such that if vr is a permutation 
in n„ and ^ is a Borel subset of T", 

Kn{Tr-s,Tr-A) = Kn{s,A). (2) 



Definition 3.1 A sequence {K^} satisfying propagates chaos if, when- 
ever {pn} is a p-chaotic sequence of symmetric laws on S*", the sequence 

I / Kn{s, ■)pnids) i 
\ J Sn ) ri=\ 

is T-chaotic for some t € V{T). 

When we say that a family of n-particle Markov processes on a state space 
S propagates chaos we mean that, for each fixed time t > 0, the family 
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of associated n-particle transition functions {Kn{s, E,t)} propagates chaos. 
Propagation of chaos will be seen to imply the existence of a semigroup 
of (typically nonlinear) operators Ft on 7^(5") such that {/ Kn{s, ■)pn{ds)} 
is Ftp-chaotic if {pn} is p-chaotic. For families of interacting particle sys- 
tems suited to the study of gases or plasmas, the semigroup {i*t}t>o is the 
semigroup of solution operators for the Boltzmann or the Vlasov equation. 

In case S is Polish, and if Definition for the propagation of chaos is 
accepted (see Remark 2 at the end of this section), we have a necessary and 
sufficient condition for chaos to be propagated, which is expressed in terms 
of the maps e„ defined in ([l|). 

Theorem 3.1 Suppose {S,ds) is a complete, separable metric space. Let 
{Kn} be a sequence of Markov transitions that satisfy condition and 
denote the symmetrization of Kn{sn, ■) by Kn{sn, ■). 

{Kn} propagates chaos if and only if there exists a continuous function 

F : V{S) — > V{T) 

such that |i^„(s„, is F{p)-chaotic whenever the points s„ € S*" are such 
that en(sn) — ^ P in T^iS)- 

Propagation of chaos is easily characterized in case the Markov transi- 
tions are deterministic, that is, when the n-particle dynamics are given by 
measurable maps from to that commute with permutations of co- 
ordinates. Let kn : — > be a measurable map that commutes with 
permutations of n-coordinates, i.e., such that 

fcn('S7r{l), S7r{2)i • • • , ■57r(n)) = ^ " kn{si, S2, ■■■ , Sn) 

for each point s G S"" and each permutation vr of the symbols 1,2,... ,n. 
Given kn, define the Markov transition Kn from to T" by 

Kn{s,E) = lEiKis)) 

when s G and E E Bxn. Say that {kn}'^=i propagates chaos if the 
sequence of deterministic transition functions {Kn} propagates chaos. 

Corollary 3.1 (Deterministic Case) Let {S,ds) be a complete and sep- 
arable metric space, and for each n let kn be a measurable map from to 
T" that commutes with permutations. 

{kn} propagates chaos if and only if there exists a continuous function 

F : V{S) — > V{T) 

such that en{kn{sn)) — > F{p) in V{T) whenever £„(§«) — ^ P in 'PiS). 
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Remark 1: Most Markov processes of interest are characterized by 
their laws on nice path spaces, such as C([0,oo),5) the space of continuous 
paths in S, or the space -D([0, oo), S) of right continuous paths in S having 
left limits. For such processes, the function that maps a state s € 5 to 
the law of the process started at s defines a Markov transition from S to 
the entire path space. Now, if a sequence of transitions Kn{s, •) from S"" 
to the path spaces C([0, oo), 5") or Z)([0, cxd), 5") propagates chaos, then, a 
fortiori, it propagates chaotic sequences of initial laws to chaotic sequences 
of laws on 5"" at any (fixed) later time. We have defined the propagation of 
chaos for sequences of Markov transitions from S*" to a (possibly) different 
space T*^, instead of simply from S"" to itself, with the case where T is path 
space especially in mind. This way, our study will pertain even to those 
families of processes that propagate the chaos of initial laws to the chaos of 
laws on the whole path space. 

Remark 2: We are adopting here a strong definition of the propagation 
of chaos. Other authors p. 42]|jl^, p. 98] define propagation of chaos 
in a weaker sense (before going to prove that chaos propagates in a variety 
of important cases). According to these authors, a family of Markovian n- 
particle processes propagates chaos if {J Kn{s, ■)p'^^{ds)} is chaotic for all 
p € ^{S) and t > 0, where p®" is product measure on 5"". In other words, 
only purely chaotic sequences of initial measures are required to "propagate" 
to chaotic sequences. This condition is strictly weaker than the one we adopt 
for our definition. For example, take S = {0, 1} and let 5{x) or 6x denote a 
point mass at x. Then, if 

K if (0,0,... ,0) 

' ' ^" I Vo,...,o) if s = (0,0,... ,0) 

for all t > 0, the sequence {Kn} propagates chaos in the weak sense, but not 
in the strong sense of our definition. Under these K^s, the (5(0)-chaotic se- 
quence {(5(0,0,... ,0)} is propagated to itself, while other (5(0)-chaotic sequences 
are propagated to (5(l)-chaotic sequences, and yet other (5(0)-chaotic se- 
quences are not propagated to chaotic sequences at all. 



4 Proof of Theorem [XT] 

Let {X,dx) be a metric space, and Di C D2 C • • • an increasing chain of 
Borel subsets of X whose union is dense in X. For each natural number n, 
let /„ be a measurable real- valued function on 

Consider the following four conditions on the sequence {/n}- They are 
listed in order of decreasing strength. 
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[A] Whenever {fin} is a weakly convergent sequence of probability mea- 
sures on X with fin supported on then the sequence 

\ / fn{x)fln(.dx) \ 
y.JX ) n=l 

of real numbers converges as well. 

[B] Whenever {fin} is a sequence of probability measures on X that 
converges weakly to 5{x) for some x G X, and fin is supported on D„, then 
the sequence {/j^ also converges. 

[C] Whenever {dn} is a convergent sequence of points in X, with dn G 
Dn, then {/n(dra)} also converges. 

[D] There exists a continuous function f on X towards which the func- 
tions /„ converge uniformly on compact sets: for any compact K C X, and 
for any e > 0, there exists a natural number N such that, whenever n > N 
and d e DnDK, then \f{d) - /„((i)| < e. 



Lemma 4.1 If X is a Polish space, i.e., if X is homeomorphic to a com- 
plete and separable metric space, and sup^g£)^{|/„((i)|} < B for all n, then 
conditions [A], [B], [C], and [D] are all equivalent. 

Sketch of Proof: 

[A] =^ [B] =^ [C] =^ [D] even when X is not Polish. 

To get [D] =^ [A], we are assuming that X is Polish, for then there 
must exist, by Prohorov's theorem, compact sets which support all of the 
measures of the convergent sequence {fin} to within any e > 0. (Prohorov's 
theorem states that if {X, T) is Polish, then T, C 'P{X) is tight if and only 
if its closure is compact in V{X).) ■ 

Let S and T be Polish spaces. For each natural number n, let Kn be a 
Markov transition from to T" that satisfies the permutation condition 
@. Henceforth, the notation e„ is used both for the map from S"' to n- 
point empirical measures on 5 and for the same kind of map on T". e„(5'") 
denotes the subset of V{S) that consists of discrete laws of the form (|l|). 

Now, Markov transitions Kn from 5" to T" induce Markov transition 
functions Hn from e„(S'") to e„(T") defined by 

Hn{C,G):= [ Jn{C,ds)Kn{s,e-\G)) (3) 
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for C G e„(S'") and G a measurable subset of en{T'^), where J„ is the Markov 
transition from e„(5") to such that Jn(C) ') that allots equal probability 
to each of the points in £~^{{(}). Note that Jn(Ci ') ° = '^(0- 



Theorem shows that propagation of chaos by a sequence {Kn} is 
equivalent to the following condition on the sequence of induced transitions 
{Hn}: 

Lemma 4.2 The sequence of Markov transitions {Kn} propagates chaos if 
and only if, whenever {fin} converges to 5{p) G V{V{S)) for some p € V{S), 
with fin supported on en{Sn) for each n, the sequence 



HniC,-)f^nidC)} (4) 



n=l 



converges in V{V{T)) to 6{q), for some q € V{T). 
Proof: 



By condition (v) of Theorem 2.1, {fXn G ^(£n(5'"'))} converges to a 
point mass 5{p) € V{V{S)) if and only if | Jn{C: ')lJ'n{dC}^ is chaotic. 

Therefore, the sequence of transitions {Kn} propagates chaos if and only if 

( / i^„(s,.) / Jn{C,ds)f,n{d0\ (5) 

is chaotic whenever fin — > ^{p)- By part (v) of Theorem 2T again, the 
sequence (|5|) is chaotic if and only if 

( / Kn{s, •) / J„(C, ds)/i„(dC) ]oen'^ S{q) 

for some q G V{T). But, by definition (^) of the transitions Hn-, 

if Knis,-) [ J„(C,rfsK(dC) ) oe-i= / i/„(C,-K(dC), 

SO {Kn} propagates chaos if and only if the sequence @ converges to 6{q) 
for some q £ V(T) whenever {fin} converges to 5{p) S V(V{S)). ■ 
Having Lemmas |4.1| and [4.2| in hand, we proceed to the 



Proof of Theorem 3.1 
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For each bounded and continuous function 
functions (j)n ■ EniS"^) — > M by 



G Cb{V{T)) define the 



MO 



V{T) 



(t>{v)Hn{C,dr,), 



(6) 



are bounded 



where Hn is as defined in (ISj). Note that the functions 
uniformly in n since <j) is bounded. 

Assume first that {Kn} propagates chaos. We will show that there exists 
a continuous function F : V{S) — > V{T) such that |ir„(s„,-)| is F{p)- 

chaotic whenever the points s„ G S*" are such that en(sn) — > P in T^iS)- 

Since {i^n} propagates chaos, Lemma [4.2| implies that whenever G 
V{£n{S''))} converges in V{V{S)) to 5{p), then 



en{S") 



MOMdC) — > (j){q) 



(7) 



for some q G V{T). In fact, Lemma 4.2 implies that q does not depend on 
our choice of (f>: the same q works for all in (|^. 

Condition (j^ resembles condition [B] above, so Lemma 4.1 shows that 
there exists a continuous function G^{p), depending on such that if {s„ G 
S""} is a sequence satisfying Sni^n) — ^ P in T^iS), then 

^n(en(Sn)) ^ G^{p). 

I^y (0)) G^{p) = (f){q) for some g G V(T) that does not depend on (f>. The 
only way that all the G^'s can have this form and yet all be continuous is 
for the dependence of g on p to be continuous: there must be a continuous 
F from V{S) to V{T) such that G^{p) = ^{F{p)) for ah </) G CbiV{T)). 
Thus, there exists a continuous function F from V{S) to V(T) such that 



P] 



for all G Ch{V{T)). This fact, and the definitions (^) and (P) of and 
0, imply that 



K„(S„, •) o En 



-1 



5(F(p)) 



Finally, by Theorem 2.1, we have that 



) — ^ P] =^ \ Kn{sn, ■) > is F(p)-chaotic. 

J n=l 
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This demonstrates the necessity of the condition of Theorem |3.1| . Next 
we demonstrate its sufficiency, i.e., that {Kn} propagates chaos if there 
exists a continuous function F : V{S) — > V{T) such that {i^„(s„,-)} is 
F(p)-chaotic whenever en(sn) converges weakly to p G T^iS). 

Suppose Pn G V{S^) is p-chaotic. Let fin = Pn ° ^n^- Then — > d{p) 
in V{V{S)) by Theorem Our goal is to prove that 

Hr,{C,drf)fjin{dC) ^ 5{F{p)), 

V(S) 



where Hn is as defined in This is enough, by Lemma 4.2, to demonstrate 
that chaos propagates. 

By hypothesis, if {s„ € S"} is such that en(sn) converges to p then 
{Kn{^m ■)} is -F(p)-chaotic. By Theorem |2.1| and the fact that 

Kn{sn, ■) o = i?„(e„(s„), •), 

the hypothesis is equivalent to the statement that, if Pn £ ^n{S^) for each 
n, then 

\pn^p\ =^ [HniPn, •) ^ d{F{p))] . (8) 

The hypothesis (^) and equation @ imply that for each (p S Cb{V{T)), 

lim (f>n{pn) = 4>{F{p)) 

n^oo 

when Pn — > p with pn € e„(S'"). We are assuming S is complete and 
separable, therefore so is V{S) 

We may now apply Lemma [4.1| with 



X = V{S), Dn = en{S^), fn 

and conclude that 



n— +00 



lim / MOMdC) = HHp)) (9) 
" IV(S) 



for any sequence {fj-n} that converges to 5{p) in 'P{V{S)). 
By equations (P) and (P), 



= lim / MOi^n{dO 
" IV{S) 



lim / / (j){r])Hn{C,dr])fin{dC) 



n— »oo 



V{S) JV(T) 



hm / 0(7?) / Hn{C,dr])fin{dO, 

"' lp(T) JP(S) 
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for all (p G CbiViT)). This implies that J^^^-^ Hn{C,dr])nnidC) — > S{F{p)) 
in V(V{S)), completing the proof. ■ 
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